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1.0  INTRODUCTION 


The  determination  of  visibility  during  the  daytime  by  the  Horizon  Scanning  Imager 
( USD  (Johnson  ct  al.  1090)  is  influenced  by  a  number  of  parameters,  both  measured  and 
input.  The  system  works  essentially  through  measurement  of  the  relative  radiance  of  dark 
targets  and  the  horizon  sky,  as  explained  in  Johnson  et  al.  19X9.  These  measurements  are 
made  for  several  targets  in  each  of  several  azimuthal  directions  around  the  horizon.  An 
apparent  contrast  of  the  target  with  respect  to  the  sky  can  be  computed  directly  from  the 
measured  radiances.  Then  the  visibility  can  be  determined  from  the  apparent  contrast,  if  the 
inherent  contrast  of  the  target  w»ith  respect  to  the  sky,  and  the  range  to  the  target,  are 
known. 

An  early  study  of  the  impact  of  various  theoretical  uncertainties  is  included  in  Johnson 
et  al.  1989.  In  this  early  study,  the  impact  of  uncertain  inherent  contrast,  and  overcast  or 
partly  cloudy  horizon  sky  conditions  were  considered.  This  current  note  extends  the  study 
of  the  impact  of  inherent  contrast  uncertainties,  and  also  evaluates  the  impact  of 
measurement  uncertainties.  In  particular,  it  is  important  to  note  which  of  the  problem  areas 
can  be  readily  controlled,  and  which  represent  basic  limitations  to  the  accuracy  of  the 
device. 

This  note  will  discuss  specifically  the  sensitivity  of  visibility  determinations  to  errors 
in  input  C0,  measured  target  relative  radiance,  measured  horizon  relative  radiance,  camera 
linearity,  and  input  target  range.  Each  section  first  discusses  how  the  sensitivity  plots  for 
the  given  parameter  were  derived.  (Numeric  examples  are  given  in  some  cases.)  This  is 
followed  by  a  discussion  of  the  results  implied  by  the  plots,  Each  section  then  includes  a 
discussion  of  the  potential  sources  of  these  uncertainties,  and  potential  means  of 
minimizing  the  uncertainties. 

2.0  SENSITIVITY  TO  INHERENT  CONTRAST  VALUES 

The  inherent  contrast  is  defined  by 

C  - 


where  tLu  is  the  inherent  target  radiance,  and  bLn  is  the  inherent  background  radiance. 
Note  that  the  word  "inherent”  signifies  that  the  radiance  is  measured  from  a  distance  of  0. 
Also  note  that  if  the  target  is  black,  tL„  is  equal  to  0,  and  the  inherent  contrast  stays  fixed  at 
-1,  even  if  the  background  radiance  changes. 

The  HS1  system  does  not  measure  C();  this  value  is  an  input  set  by  the  user.  The 
visibility  is  then  computed  from  the  equation 
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where  r  is  range  to  the  target,  and  c  is  the  human  contrast  threshold  associated  with  the 
definition  of  visibility.  Cr  is  the  measured  contrast,  or  the  contrast  at  range  r.  defined  by 
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where  tLr  and  bW  are  the  target  and  background  radiances,  respectively,  at  range  r.  For  a 
full  discussion  of  these  terms,  see  Duntlev,  1957. 

Equation  2.2  is  the  primary  expression  utilized  by  the  MSI  to  derive  visibility  from  the 
measured  contrast.  This  equation  is  derived  in  Johnson  et  al,  1989.  The  derivation 
assumes  that  the  contrast  with  respect  to  the  horizon  sky  is  used,  and  the  horizon  skv 
radiance  approximates  the  equilibrium  radiance  (Lq),  defined  in  Johnson  et  al  19X9,  and 
earlier  references.  A  threshold  £  of  .05  is  normally  used  in  the  HSI:  this  is  the  value  of 
human  contrast  threshold  associated  with  the  definition  of  visibility  (ref.  Douglas  & 
Booker,  1977). 

There  are  a  variety  of  philosophical  approaches  to  determining  visibility  with  a  system 
such  as  the  HSI.  The  human  observer  using  non-ideal  visual  targets  will  make  visibility 
assessments  which  are  not  strictly  in  accordance  with  the  classically  defined  visibility.  The 
HSI  can  simulate  this  human  bias  or  not,  according  to  the  needs  of  the  application,  through 
appropriate  changes  to  Eq.  2.2.  Whereas  these  changes  would  affect  the  magnitude  of  the 
determined  visibility  to  a  limited  degree,  they  have  little  impact  on  the  results  of  the 
sensitivity  study  contained  herein. 

It  should  also  be  noted  that  although  C0  values  are  negative  for  dark  targets,  the  human 
visual  response  depends  on  the  absolute  magnitude  of  C0;  therefore  positive  Cc  values  have 
been  used  in  most  of  our  reports,  for  ease  of  presentation.  In  this  note,  the  negative  sign 
must  be  kept  in  some  of  the  internal  computations  used  to  generate  the  plots,  however  the 
positive  sign  has  been  used  in  presenting  the  results,  for  consistency  with  earlier  work. 

2.1  Computation  and  Interpretation  of  the  C«  Sensitivity  Plots 

The  sensitivity  of  the  derived  visibility  to  uncertainties  in  the  inherent  contrast  is 
illustrated  by  a  scries  of  four  plots,  labeled  "Test  la"  through  "Test  Id".  The  first  plot, 
labeled  Test  la.  shows  the  sensitivity  of  derived  visibility  to  changes  in  input  Cn  when  the 
actual  C0  value  is  0.8.  That  is.  if  we  are  measuring  a  target  which  has  an  inherent  contrast 
of  -O  X  with  respect  to  the  sky.  but  we  input  some  other  value,  what  is  the  error  in  derived 
visibility  due  to  this  input  error.  The  visibility  wc  would  derive  is  given  by  Eq.  2.2  using 
the  input  C0;  the  visibility  we  should  have  derived,  given  the  correct  C0  value,  is  given  by 
Eq.  2.2  with  a  C()  of  0.X  input. 

Thus  to  determine  the  error  in  the  derived  visibility,  one  first  computes  visibility  using 
the  input  C0  value  and  Eq.  2.2.  then  divides  this  by  the  visibility  computed  using  a  C() 
value  of  O.X.  For  example,  if  a  target  at  range  10  miles  has  an  apparent  contrast  Cr  value  of 
0,2.  and  the  correct  C,,  is  O.X.  the  derived  visibility  found  using  Eq.  2.2  should  be  20 
miles.  An  input  C„  value  of  O  h  would  vicld  a  derived  visibility  of  22.6  miles,  for  tin  error 
of  1  .V,r  . 

The  error  is  computed  for  a  range  of  input  Cr  and  C0  values.  Note  that  the  error  does 
riot  depend  on  the  input  range  (r)  value,  and  the  input  £  value  is  not  normally  varied;  thus 
thew  variables  do  not  impact  the  assessment  of  the  error  due  to  Cn  uncertainty. 

In  the  Test  la  plot,  the  uncertainty  is  plotted  as  a  function  of  measured  apparent 
contrast  Cr.  Note  that  when  Cr  is  close  to  .05,  the  error  approaches  0.  Physically,  this 
occurs  when  the  target  is  at  a  range  about  equal  to  the  visibility;  that  is,  the  apparent 
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contrast  approaches  the  visual  threshold  of  .05  when  the  target  range  is  close  to  the 
visibility.  Thus  the  plot  may  be  interpreted  as  showing  that  the  error  due  to  uncertaum  m 
('o  is  quite  small  if  the  target  range  is  similar  to  the  visibility,  anil  becomes  large:  as  the 
target  range  becomes  signify. i.iily  icss  than  the  visibility. 

The  HSI  algorithm  has  two  automatic  cutoff  values.  When  V/r  is  less  than  115  or 
greater  than  4.0,  the  visibility  value  is  given  a  greater  than'  or  "less  than"  value.  In  Test 
la,  the  curves  are  plotted  in  black  (solid  lines:  where  the  V/r  values  lie  within  this  range 
and  the  derived  visibility  values  are  used;  the  portions  o(  the  curve  which  are  grey  w 
where  V/r  values  are  outside  the  bounds,  l  or  example,  if  a  (\,  v  alue  ot  .6  b  input,  the  V/r 
cutoff  occurs  at  a  measured  Cr  value  of  12.  and  the  maximum  error  is  about  30' i .  !  he 
grey  curves  show  what  the  error  would  be.  if  the  possible  C  ’r  range  w  ere  changed  due  to  a 
change  in  the  V/r  cutoffs. 

Test  1  b  shows  the  sensitivity  of  visibility  to  C0  input  errors,  if  the  actual  (’<>  is  5.  The 
values  of  .X  and  .5  for  actual  Cu  were  chosen  for  tests  la  and  lb.  because  they  are  close  to 
the  normal  bounds  we  might  expect  to  use.  A  Cu  of  X  is  perhaps  typical  of  the  blackest 
targets  we  can  expect  to  find  among  targets  of  opportunity;  a  C()  value  of  .5  w  as  chosen  to 
represent  a  significantly  non-ideal  (non  black)  target. 

Test  lb  shows  similar  characteristics  to  Test  la,  in  the  sense  that  the  error  in 
determined  visibility  due  to  the  uncertainty  in  the  C()  value  is  vanishingly  small  for  targets  at 
range  equal  to  visibility.  The  error  increases  as  the  target  range  becomes  smaller,  and 
measured  apparent  contrasts  become  larger.  The  errors  become  quite  large  at  the  maximum 
Or  values,  indicating  a  certain  risk  associated  with  using  non  ideal  targets. 

The  third  and  fourth  plots.  Tests  !c  and  Id.  show  the  impact  of  C<>  uncertainties  in  a 
slightly  different  way.  These  plots  show  the  resulting  error  if  a  fixed  input  value  is  used, 
but  the  actual  inherent  contrast  of  the  target  with  respect  to  the  horizon  sky  changes.  <('„ 
can  change  because  of  the  impact  of  changing  lighting  conditions  on  the  target  radiance;  it  is 
also  impacted  by  changes  in  the  horizon  radiance.  The  equilibrium  radiance,  anil  therefore 
horizon  radiance,  is  highly  dependent  on  the  path  of '-sight's  scattering  angle  with  respect  to 
the  sun.)  For  an  example  of  the  impact  of  changes  in  C0.  consider  the  case  above  where 
the  visibility  is  20  miles,  and  the  range  10  miles.  If  C0  is  really  .6,  it  can  be  derived  from 
Hq.  2.2  that  Cr  must  have  been  .1732.  Then  if  we  measure  Cr  -  .1732,  and  input  a  C„ 
value  of  .8,  we  will  derive  a  visibility  value  of  1 X.  1  miles,  for  a  0.45/  error. 


It  should  be  noted  that  in  Test  lc,  the  V/r  cutoffs  all  occur  at  the  same  value  of  Cr. 
Looking  at  F.q.  2.2,  one  can  see  that  if  C0  and  €  are  fixed,  V/r  will  be  directly  related  to  Cr. 
The  HSI  algorithm  must  compute  V/r  using  its  input  value  of  C,,.  In  Tests  lc  and  Id.  that 
input  CV  value  is  not  changing,  so  the  values  of  Cr  associated  with  the  V/r  cutoffs  do  not 
change.  In  Tests  la  and  lb.  the  input  value  of  C0  is  changing,  and  therefore  the  Cr  value  at 
which  a  given  V/r  threshold  occurs  changes  too. 

2.2  Results  of  the  C<>  Sensitivity  Computations 

As  noted  in  the  previous  section,  the  errors  in  derived  visibility  (due  to  C()  uncertainty) 
go  to  0  when  the  target  range  equals  visibility.  At  shorter  ranges,  the  error  can  become 
quite  large.  Thus,  all  four  of  the  plots  show  quite  dearly  that  it  is  important  to  know  the  C,, 
value  reasonably  well.  1  or  example,  fiom  Test  la.  tl  the  actual  inherent  contrast  is  X,  and 
it  one  wishes  to  have  an  error  less  than  20' I.  the  ermr  in  (  ,,  must  be  a  Iron  t  1  or  less 
( w  hen  ( is  X). 
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It  is  also  quite  obvious  that  the  uncertainty  is  much  less  for  ideal  black  targets  than  for 
non-ideal  targets.  In  Test  lb,  with  actual  inherent  contrast  of  .5,  the  error  can  exceed  20'8- 
even  if  the  contrast  is  known  to  within  an  uncertainty  of  .1  or  less.  This  implies  that  if  a 
non-ideal  target  is  used,  there  will  be  loss  of  accuracy  unless  the  Ct)  is  very  tightly 
specified,  or  the  range  of  acceptable  Cr  values  is  more  tightly  limited. 

Hven  if  we  accurately  specify  the  C(,  value  at  some  point  in  time,  the  system  is 
somewhat  vulnerable  to  natural  changes  in  Ct).  As  shown  in  Test  lc,  the  resulting  visibility 
errors  are  probably  reasonable  when  a  target  near  C0=.X  is  used.  The  error  resulting  from 
a  change  in  C0  for  targets  near  Ciy=.5.  shown  in  Test  Id,  are  quite  large,  implying  that  we 
probably  should  not  use  targets  vs  ith  Cu  values  as  low  as  .5. 

Hven  though  these  C„  sensitivity  plots  demonstrate  a  basic  limit  of  system  accuracy, 
there  are  some  available  trade-offs.  We  can  help  optimize  system  accuracy  by  utilizing  a 
combination  of  several  options  such  as; 

a)  Limiting  our  targets  to  C0  values  closer  to  !;  i.e.  we  should  probably  exclude  any 
targets  with  Cu  <  .5. 

b)  Using  V/r  thresholds  which  depend  on  C,>.  That  is,  we  could  allow  V/r  values  as 
high  as  4  when  Cu  is  close  to  .8,  but  use  a  V/r  limit  which  is  smaller  when  C()  is 
less. 

c>  Determine  more  accurate  C,,  values,  and  better  characterize  variations  in  C0  due  to 
changes  in  horizon  brightness,  thus  minimizing  errors  in  input  C(>  as  discussed 
below. 

Study  of  the  normally  occurring  C()  variations  in  the  available  targets  of  opportunity,  in 
conjunction  with  the  use  of  the  plots  (laid)  which  show  the  impact  of  these  variations, 
should  allow  us  to  optimize  these  tradeoffs. 

Regarding  option  "c"  above,  there  has  been  considerable  interest  in  extracting  the  C0 
values,  as  discussed  in  Section  5  of  Johnson,  et  al,  1  WO.  If  the  visibility  for  a  given  scene 
can  be  determined,  either  based  on  a  median  value  for  the  targets,  or  based  on  an 
independent  source,  one  should  be  able  to  back  out  the  value  of  C(,  required  for  a  given 
target  to  yield  that  visibility  value. 

The  first  goal  of  a  (\>  study  would  be  determination  of  the  differing  C„  values  for  a 
variety  of  targets.  A  second  goal  would  be  characterizing  the  variation  in  C0  over  time  for 
each  target.  This  variation  of  Cj,  over  time,  for  a  given  target,  is  caused  by  changes  in  (1  0 
as  well  as  changes  in  pl-o-  The  changes  in  ^L,,  are  most  strongly  driven  by  changes  in 
scattering  angle  with  respect  to  the  sun;  this  should  be  well  behaved.  Changes  in  p,L0  due 
to  aerosol  load  should  be  more  difficult  to  handle.  Likewise,  changes  in  (1.0  due  to  the 
changing  lighting  distribution  on  the  target,  as  weighted  by  the  directional  reflectance  of  the 
target,  are  complex.  Whereas  it  should  be  possible  to  improve  our  current  handling  of 
input  C,,  values,  we  do  not  expect  to  fully  predict  the  C„  behavior. 

In  order  to  enable  a  C„  study,  it  is  first  important  to  understand  other  sources  of  error 
on  visibility:  this  was  part  of  the  reason  for  making  this  current  study.  It  may  also  be 
important  to  derive  curves,  similar  to  those  shown  in  the  following  section,  which  show 
the  sensitivity  of  the  extracted  value  to  various  types  of  error.  In  this  way,  the  study 
can  he  designed  to  maximize  the  C„  information  returned,  and  minimize  the  impacts  of 
measurement  error  on  the  ( j,  determination. 


3.0  SENSITIVITY  TO  MKASIREI)  TARGET  INCERTAINTIES 


la  any  measurement  system,  there  are  limits  to  measurement  accuracy.  In  the  USE 
these  can  l>e  caused  by  a  number  of  factors  such  as  measurement  noise  or  non-uniformity 
in  the  basic  chip  sensitivity.  This  section  discusses  the  impact  of  uncertainties  in  the 
measured  target  relative  radiance. 


3.1  Compulation  of  Sensitivity  to  Measured  Target  Uncertainties 

The  signal  from  the  target  is  actually  a  relative  radiance,  in  the  sense  that  relative,  but 
not  absolute,  radiances  are  determined  over  the  scene.  This  is  a  result  of  the  use  of  the 
auto-iris.  The  auto-iris  causes  a  fixed  percentage  change  over  the  whole  scene.  From  the 
definition  of  apparent  contrast.  F.q.  2.3,  it  may  fie  shown  that  these  relative  radiances  yield 
an  absolute  measurement  of  apparent  contrast. 

The  radiances  are  digitized  on  the  image  board  by  an  A/D  converter,  to  yield  signals 
between  0  and  255.  In  this  section  we  determine  the  error  in  computed  visibility  if  there  are 
known  errors  in  this  digitized  signal.  Signal  noise  is  normally  about  2-3  counts,  whether 
the  signal  is  near  0  or  near  255.  Many  other  types  of  signal  errors  we  observe  appear  to  be 
primarily  additive,  i.e.  of  a  fixed  value  rather  than  a  fixed  percentage  of  the  signal. 
Therefore,  it  was  decided  to  determine  the  visibility  error  for  signal  errors  of  a  given 
magnitude  rather  than  a  given  percent.  Errors  of  ±  2  and  ±  4  counts,  on  the  0-255  scale, 
were  selected. 

An  error  in  the  measured  target  relative  radiance  will  cause  an  error  in  the  apparent 
contrast  of  the  target  with  respect  to  the  horizon  sky.  The  resulting  error  in  derived 
visibility  is  itself  a  function  of  the  apparent  contrast.  In  order  to  present  the  data  in  a 
manner  which  would  be  useful  for  further  engineering  studies,  it  was  decided  to  plot  the 
resulting  error  as  a  function  of  the  measured  apparent  contrast,  rather  than  the  actual 
apparent  contrast  (because  the  HS1  can  only  return  the  measured  apparent  contrast). 

If  there  is  an  error  given  by  the  variable  Err.  the  measured  apparent  contrast  becomes 

T  (:Lr  +  Err  ~*Lr) 

tLr  3.1 

(where  the  minus  sign  converts  to  (he  positive  Cr  values  used  in  the  plots).  Suppose  one 
obtains  a  measured  contrast  of  Cr .  which  includes  an  error  as  given  in  F.q.  3.1.  One  can 
show  that  the  actual  apparent  contrast  Cy  is  related  to  this  measured  apparent  contrast  by 
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0, 


4  2 


Then  we  can  compute  the  visibility  the  IIS!  would  return  from  using  F.q.  2.2  with  an  input 
value  of  Cr.  and  we  can  compute  the  correct  visibility  (associated  with  0  error)  by  using 
Hq.  2.2  with  an  input  value  oft’,',  as  given  by  Fq.  3.2. 

Note  that  by  using  this  approach,  in  conjunction  with  Fq.  3.2,  one  derives  the 
visibility  error  as  a  function  of  the  measured  (erroneous)  Or  value.  This  is  somewhat  more 
complex  than  computing  the  visibility  error  as  a  function  of  actual  apparent  contrast  (i.e.  the 


value  that  would  have  been  measured  in  the  absence  of  error).  It  was  decided  to  use  the 
measured  apparent  contrast  in  the  plot,  since  this  is  the  parameter  which  is  available  on  the 
HSI. 

As  an  example,  if  C„  is  .X,  and  the  measured  horizon  brightness  is  1  ( K).  as  in  Test  2a. 
and  a  measured  Cr  value  of  -.2  is  obtained  for  a  target  at  range  10  miles,  this  means  that  the 
measured  target  radiance  was  X0.  If  this  target  radiance  measurement  included  an  error  of 
+4,  then  the  actual  target  radiance  should  have  been  76.  That  is,  the  measurement  was  +4 
too  high.  Then  the  actual  Cr  value  should  have  been  -.24.  The  actual  visibility,  obtained 
from  using  .24  in  F.q  2.2,  is  23.0  miles,  whereas  the  visibility  returned  by  the  HSI  would 
be  20  miles,  which  is  1 V7<  low. 

Tests  2a  through  2d  are  plotted  as  a  function  of  the  measured  Cr.  Since  Hi],  3.2 
depends  on  horizon  brightness,  plots  have  been  created  for  horizon  brightnesses  of  200. 
which  are  the  normal  setting,  and  1(H),  which  is  normally  the  lower  limit.  The  results  are 
also  dependent  on  C(,.  and  have  been  computet!  with  values  of  X  and  .5. 

3.2  Evaluation  of  Sensitivity  to  Measured  Target  I  ncertainties 

The  deviations  in  the  Test  2  series  are  somewhat  less,  in  general,  than  those  shown  in 
the  Test  1  series.  That  is.  the  sensitivity  to  measured  target  uncertainty  is  in  general  less 
than  the  sensitivity  to  Cu  uncertainty.  The  error  in  visibility  is  most  sensitive  to  measured 
target  uncertainties  at  low  Cr  values,  i.e.  when  the  target  range  is  close  to  the  visibility. 
That  is.  whereas  the  4.0  V/r  cutoff  is  critical  in  minimizing  errors  due  to  C(>  uncertainties,  it 
is  the  other  end,  the  1.15  V/r  cutoff,  which  is  critical  in  minimizing  errors  due  to  iHr 
uncertainties. 

A  comparison  of  Tests  2a  and  2b  shows  immediately  that  there  is  considerable 
advantage,  in  terms  of  this  type  of  error,  in  keeping  the  horizon  radiance  high.  If  the  auto¬ 
iris  is  set  so  that  the  horizon  radiance  stays  near  200.  and  targets  w  ith  C0  near  .X  arc  chosen 
(Test  2b).  the  error  resulting  from  a  measurement  error  of  ±  2  is  less  than  57c  over  most  of 
the  span. 

The  situation  is  not  quite  so  good  when  targets  w  ith  C,>  values  near  .5  are  chosen,  as 
shown  in  Tests  2c  and  2d.  Test  2c  illustrates  that  the  combination  of  low  C„  and  low- 
horizon  radiance  are  the  worst  case.  In  this  plot,  the  error  resulting  from  a  measurement 
error  of  ±  2  is  between  10  and  20'v . 

An  obvious  first  step  m  utilizing  these  results  is  to  ensure  that  the  auto  iris  is  set  so  that 
the  measured  horizon  radiances  are  reasonably  high.  i.e.  near  2<K). 

It  would  be  useful  to  determine  the  source  and  magnitude  of  typical  measurement 
errors.  Whereas  the  electronic  noise  can  create  an  error  of  2-3  counts  in  a  specific  pixel, 
the  measured  target  radiances  are  normally  the  average  of  several  pixels,  and  should  not  be 
subject  to  large  random  errors  We  need  to  determine  the  typical  error  due  to  noise  in  the 
spatially  averaged  signal.  If  it  is  too  large,  additional  temporal  averaging  could  be  used  to 
minimize  it. 

A  slow  rise  in  the  dark  cm  rent  signal  could  also  contribute  to  a  measurement  error. 
This  may  be  more  important  than  the  noise,  since  spatial  averaging  does  not  decrease  the 
error.  Again,  the  data  needs  to  be  evaluated  to  determine  tvpical  error  magnitudes.  If 
necessary,  a  light  trap  could  be  installed  at  one  azimuthal  look  angle,  to  enable 
measurement  and  correction  of  the  dark  signal. 
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Test  2d  Sensitivity  of  Derived  Visibility  to  Measured  Target  Radiance  Uncertainly  Co  =  5  Lq  =  200 


Another  source  of  measurement  error  is  the  spatial  non  uniformity  in  the  sensor  chip 
This  can  he  evaluated  hv  extracting  the  signal  for  the  various  target  positions,  from  a 
calibration  measurement  taken  with  uniform  lighting  on  the  chip.  (This  calibration 
measurement  has  already  been  acquired  at  a  variety  of  light  levels,  as  part  of  the  linearity 
calibration.)  If  this  non-uniformity  is  found  to  be  large  enough  to  cause  a  significant  error 
(as  indicated  by  Tests  2a-2d),  the  non  uniformity  could  easily  be  compensated  for  in  the 
visibility  algorithm. 

As  with  the  C«  sensitivity  study,  the  plots  which  have  been  generated  show  the 
sensitivity  of  visibility  to  a  given  error;  m  this  ease  a  measurement  error.  It  remains  to 
determine  the  magnitude  of  the  measurement  errors  which  exist,  and  then  decide  which  it 
any  of  the  above  correction  procedures  seem  warranted. 

4.0  SENSITIVITY  TO  MEASURED  HORIZON  BRIGHTNESS 
UNCERTAINTIES 

Just  as  there  nitty  be  errors  in  the  determination  of  the  target  relative  radiance,  there 
may  be  errors  in  the  determination  of  the  horizon  relative  radiance.  These  errors  fall  into 
two  quite  distinct  categories.  There  may  be  measurement  errors,  in  which  the  returned 
signal  is  incorrect  due  to  noise,  dark  current,  or  chip  non- uniformity.  And  there  may  be 
errors  in  the  visibility  determination  because  the  measured  background  sky  is  not  in  fact  the 
same  as  the  equilibrium  radiance,  due  to  either  misplacement  of  the  horizon  region  ol 
interest,  or  contamination  of  the  region  of  interest  by  clouds,  or  other  obstructions  to 
visibility. 


In  either  case,  there  is  an  error  in  the  determination  of  what  is  assumed  to  be 
equilibrium  radiance.  If  this  error  has  a  given  magnitude,  in  terms  of  signal  change,  the  net 
effect  on  the  derived  visibility  will  be  the  same.  Thus,  although  these  plots  are  primarily 
intended  to  show  the  effect  of  measurement  error,  they  can  also  be  used  to  evaluate  the 
impact  of  deviations  from  the  ideal  clear  horizon.  Test  set  3a- 3d  evaluates  the  sensitivity  of 
derived  visibility  to  the  measurement  uncertainties. 

4.1  Computation  of  Sensitivity  to  Measured  Horizon  Uncertainties 

As  with  the  earlier  plots,  we  wish  to  plot  the  errors  as  a  function  of  the  measured 
(rather  than  actual)  apparent  contrast.  If  there  is  a  measurement  error  in  the  horizon 
radiance,  then  the  measured  apparent  contrast  (allowing  for  the  change  in  sign)  becomes 

r  -(A-(„C  +tirr)) 

\hl.r  +  Err)  4] 

(similar  to  Hq.  3.1  ).  Then  it  can  also  lx-  shown  that  for  a  measured  Cr  value,  as  given 
above,  the  correct  value  of  apparent  contrast,  C'/,  is  given  by 

r'=s  C,  hl.r  +  En(Cr- 1) 


Since  this  is  similar  in  concept  to  the  derivation  of  the  error  resulting  from  target 
measurement  uncertainty,  I  will  not  show  a  numeric  example.  As  with  the  previous  test 
set,  sample  computations  have  been  made  for  horizon  radiances  of  100  and  200,  and 
values  of  .X  and  .5. 
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Test  3d  Sensitivity  ot  Derived  Visibility  to  Measured  Hori/on  Radiance  Uncertainly  Co  =  5  L  q  =  200 


4.2  Evaluation  of  Sensitivity  to  Measured  Mori/on  Uncertainties 

Plots  3a-3d  arc  quite  similar  10  plots  2a  2d.  On  each  of  the  lour  plots,  the  largest  error 
occurs  when  Cr  values  are  near  Oh.  That  is.  as  with  Plots  2a  2d.  the  worst  effect  ot  the 
measurement  error  occurs  when  the  target  range  is  close  to  the  visibiluv  The  V/r  cutot!  at 
1.15  protects  the  system  trom  the  largest  errors  tin  the  grey  region  of  each  lino 

A  comparison  of  plots  5a  and  fh  tas  well  as  sc  vs  3di  show s  the  significant  advantage 
in  keeping  the  horizon  radiance  values  near  200  (through  proper  setting  of  the  auto  iris) 
Similarly,  a  comparison  ol  plots  f.i  vs  3c.  and  3b  vs  3d.  shows  the  advantage  of  using 
dark  targets,  with  inherent  radiances  dose  to  ,K  (or  close  to  1.  ideally  ). 

As  with  the  previous  tests,  follow  up  action  should  include  evaluation  of  the 
magnitude  of  typical  errors.  The  horizon  radiance  can  he  impacted  bv  t fie  same 
measurement  errors  mentioned  in  Section  3  2.  namely  noise,  dark  offset,  and  chip  non 
uniformity.  In  addition,  we  need  to  evaluate  the  magnitude  of  the  signal  error  due  to 
misplacement  of  the  horizon  region  of  interest  ( KOI )  or  corruption  of  the  scene  by  clouds. 
It  might  he  reasonable  to  acquire  two  horizon  HOi's.  and  evaluate  the  standard  deviation  in 
each  KOI  as  well  as  the  comparative  brightness,  in  this  way  the  HSf  could  automaticallv 
detect  cases  in  which  the  horizon  is  impacted  by  clouds,  ({valuation  of  the  data  to 
determine  the  merit  of  these  various  schemes  for  improving  equilibrium  radiance 
determination  seems  appropriate 

5.0  SENSITIVITY  TO  NO VI.INF. ARITY  OF  CAMERA  RESPONSE 

The  CID  sensor  chip-,  in  the  camera,  m  conjunction  with  the  camera  electronics,  yield  a 
reasonably  linear  camera  tespor.se.  That  is.  the  output  signal  is  m  general  proportional  to 
the  input  brightness  (or  relative  radiance  in  object  space).  However,  the  relation  is  not 
perfect,  particularly  near  the  high  end  of  the  camera  sensitivity  range.  Therefore  an 
evaluation  of  sensitivity  to  this  tv  jx*  of  error  seems  appropriate. 

5.1  Computation  of  Sensitivity  to  Measured  Non-linearity 

Computations  ot  the  error  resulting  from  camera  non  linearity  are  relatively  straight 
forward.  Linearity  calibrations  have  been  acquired  for  .ill  cameras:  they  are  reduced  as 
discussed  in  Memo  AYkd  05bt  The  output  of  a  linearity  calculation  is  a  look-up  table, 
for  each  measured  signal  value,  this  table  lists  a  corrected  signal  which  is  linearly  related  to 
the  original  radiance  generating  the  measured  signal. 

11  the  horizon  has  a  measured  brightness  given  by  i,Lr.  mid  the  measured  contrast  is 
(',.  it  can  lx*  shown  that  the  measured  target  radiance  is  given  bv 

if  f  ;  id-,  <1  C,>  51 

fallow  ing  tor  the  change  in  sign  in  (  ,i 

for  a  given  Cr  value,  the  visibility  returned  by  the  MSI  is  given  by  bq.  2.2.  The 
visibility  which  has  been  corrected  for  die  non  linearity  may  be  obtained  bv  running  the 
horizon  radiance  through  the  linearity  look  up  table,  running  the  target  radiance  in  bq.  5  1 
through  the  look-up  table,  and  recomputing  visibility. 

As  an  example,  let  C(1  equal  H.  and  the  horizon  radiance  equal  1(K).  as  in  Test  -la. 
When  C"r  --  .2.  the  d  r  value  computed  from  Fq,  5.1  is  HO  Application  of  the  linearity  table 
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lor  the  first  s\  stem  ( line;mt\  test  I.IN020)  correets  the  value  of  SO  to  X2.2,  and  the  value  ot 
100  to  100.7.  The  eorreeted  contrast,  derived  from  i'q  2  v  becomes  1X4.  The  corrected 
visibility,  from  1  q  2.2,  is  then  IS  S  when  the  target  ranee  in  10  The  visibility  returned  by 
the  HS1  can  be  directly  computed  from  1  q  2  2.  using  2.  this  value  is  20,  which  o 

thus  about  69'  high. 

As  in  the  previous  sections,  these  computations  have  (veil  run  tor  -  .5  and  K.  and 
hori/on  radiance  ~  100  and  200.  In  addition,  computations  have  been  made  for  horizon 
radiance  -  220,  for  the  following  reasons.  The  camera  sensitivity  tends  for  most  systems 
to  be  reasonably  linear  over  most  of  the  span,  but  tends  to  become  increasingly  non  Imeai 
as  the  upper  limit  of  2? 5  is  approached.  Since  the  error  can  become  somewhat  critically 
dependent  on  die  hori/on  radiance  above  200.  it  was  decided  to  run  additional  calculations 
for  a  horizon  signal  of  220  The  resulting  set  of  6  plots  arc  labeled  Test  4a  through  Test  4! 

In  each  plot,  four  curves  are  given.  The  first  curve,  from  linearity  LIN020,  is  for  the 
camera  which  is  currently  at  Ot  is.  The  third.  1.1N02S.  is  for  the  camera  currently  at  MPI. 
The  other  two  are  randomly  chosen  linearities  (the  ones  that  happened  to  be  on  my 
computer),  and  were  acquired  for  cameras  used  in  WSI  units  They  are  included  to  give 
the  reader  a  better  feel  for  the  range  of  values  that  might  occur. 

5.2  I A  ablation  of  Sensitivity  to  Measured  Non-linearity 

The  sensitivity  curves  for  the  linearity  are  not  so  well  behaved  as  the  earlier  plots. 
Consider  first  Tests  4a  through  4c,  i.e.  those  with  C0~.X.  In  Test  4h,  one  can  see  that  for 
l  .q  values  of  200,  all  four  cameras  yield  pretty  similar  results:  the  error  is  about  -59?  to 
-109? ,  and  essentially  independent  of  the  Cr  value.  When  the  horizon  radiance  ts  higher,  at 
a  level  of  220  (Test  4c).  one  of  the  cameras,  represented  by  LIN024,  has  a  quite  large  error 
of  about  259? .  This  occurs  because  this  one  camera  is  still  reasonably  linear  at  a  signal  of 
2(H),  but  is  somewhat  non-linear  at  the  signal  of  220.  At  the  I-n  value  of  100.  shown  in 
Test  4a.  three  of  the  systems  are  quite  accurate,  but  one  is  about  10r?  high. 

The  plots  for  C0  =  .5.  Tests  4d  through  4f.  are  similar  in  character,  although  the 
magnitudes  of  the  errors  become  somewhat  larger. 

As  noted  above,  several  of  the  plots,  such  as  Test  4b,  show  little  variance  in  the 
percent  error  as  Cr  is  varied.  This  implies  that  in  a  given  scene,  both  near  and  far  targets 
would  have  roughly  the  same  percent  error.  Thus  the  non-linearity  of  the  camera  causes,  in 
this  example,  an  overall  bias  in  the  visibility  determination,  rather  than  a  lack  of  consistency 
between  the  individual  target  returns. 

It  is  helpful  to  understand  why  the  ef  fect  of  the  non-linearity  can  be  so  large.  Consider 
the  case  of  the  horizon  radiance  set  at  2(H),  and  an  inherent  contrast  of  .8.  The  V/r  limits 
serve  to  limit  the  (',  range  to  .07  to  .4.  In  terms  of  target  radiance,  this  means  that  the 
signal  can  be  used  only  if  it  is  between  120  and  1X6.  This  means  that  only  a  somewhat 
narrow  range  of  signals  arc  being  used  in  the  visibility  determination.  The  determination  is 
essentially  based  on  difference  measurements;  precision  becomes  quite  critical.  The 
numeric  example  in  Section  5.1  is  a  good  example  of  this.  The  linearity  correction  was 
only  about  2.2  at  a  signal  of  XO  (a  39?-  correction),  yet  the  impact  was  a  69?  change  in 
determined  visibility. 

The  non  linearity  is  an  instrumentation  characteristic  which  can  be  compensated  for  in 
the  software  To  the  extent  that  we  arc  able  to  characterize  the  system  response  accurately, 
and  to  the  extent  that  that  response  docs  not  change,  we  should  be  able  to  make  reasonable 
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corrections.  The  next  section  discusses  further  the  extent  to  which  this  system  response 
can  he  characterized. 

5.3  Characterization  and  Stability  of  System  Response;  Implications 

As  noted  above,  the  linearity  correction  can  be  quite  critical.  Applying  a  linearity 
correction  is  easy  and  quick,  in  terms  of  software  development  and  processing  time. 
However  it  is  important  that  the  application  of  the  linearity  actually  represent  an 
improvin'  in  order  for  this  to  be  true,  we  must  be  able  to  measure  the  system  response 
accurately  ,  and  the  response  must  be  reasonably  stable. 

In  order  to  evaluate  the  extent  to  which  these  two  conditions  of  accuracy  and  stability 
are  true,  three  more  plots  labels  Test  5a  through  Test  5c  were  generated.  It  turns  out  that 
one  of  the  systems  characterized  in  the  Test  4  series  was  fielded  for  over  a  year,  and  then 
returned  for  post  calibration.  This  system,  characterized  by  linearity  I.1N024,  was  chosen 
for  study. 

First,  in  order  to  characterize  the  measurement  accuracy,  a  closer  look  at  LIN024  was 
taken.  During  the  linearity  calibration,  a  duplicate  set  of  measurements  is  acquired.  First, 
the  lamp  is  moved  through  a  set  of  positions  to  characterize  the  change  from  the  bright  end 
to  the  dark  end.  Then  a  repeat  set  of  data  is  acquired,  moving  this  time  from  the  dark  end 
to  the  bright  end.  Suppose  that  at  some  point  in  time  the  repeat  set  of  data  on  the  linearity 
accurately  characterize  the  system  response,  but  we  use  the  initial  linearity  data  set  to  make 
our  correction.  The  resulting  error  gives  a  measure  of  our  measurement  uncertainty  caused 
by  signal  to  noise  ratio,  in  terms  of  its  impact  on  the  visibility  determination.  This  is  w  hat 
is  shown  in  Curve  1  of  Plots  5a  through  5c.  The  errors  are  quite  small;  nearly  always  less 
than  1 9c.  Thus  measurement  error  in  the  linearity  determination  is  probably  not  enough  to 
cause  a  problem.  (Another  test  was  run  in  which  a  camera  was  calibrated  using  two 
different  calibration  setup  configurations,  to  characterize  our  measurement  error  caused  by- 
stray  light  or  other  setup  errors.  The  impact  of  this  difference  on  the  visibility 
determination  is  less  than  3 9c.) 

It  is  also  important  to  test  the  impact  of  stability  of  system  response.  The  camera 
calibrated  in  LIN024  was  taken  into  the  Field  (in  a  WSI  unit)  and  run  24  hours  a  day  for 
over  a  year.  On  return,  it  was  recalibrated  (L1N042),  and  found  to  be  somewhat  truncated. 
The  full  dark  value  had  come  up  from  a  signal  of  1  to  a  signal  of  15,  and  the  full  bright 
value  had  decreased  from  226  to  210.  Thus  both  ends  had  contracted  by  counts  of  about 
15.  This  is  not  unexpected  after  a  year  in  the  field. 

Two  curves  have  been  computed  from  this  linearity  data.  C urve  2  in  Plots  5a  through 
5c.  labeled  42  vs  24,  shows  the  impact  on  the  visibility  if  the  camera  actually  has  the 
response  indicated  by  LIN042,  but  the  user  applies  the  linearity  correction  based  on 
LIN024.  Thus,  if  one  had  measured  the  camera  response  as  shown  in  I.IN024,  and 
applied  this  consistently,  but  the  camera  drifted  over  time  to  the  response  indicated  by 
L1N042,  the  resulting  error  in  the  computed  visibility  would  be  as  shown  in  Curve  2. 
Curve  3  shows  the  error  if  the  response  is  as  indicated  by  LIN042,  and  no  linearity 
correction  is  made.  Thus  these  two  curves  show  the  impact  of  drift  in  system  response, 
w  ith  and  without  the  use  of  the  pro -deployment  calibration. 

The  error  shown  in  curves  2  and  3  of  Plots  5a  through  5c  is  disconcertingly  large.  It 
is  probably  not  atypical.  Most  of  the  cameras  experience  an  increase  in  the  dark  level  of  15 
to  30  counts  in  the  period  of  a  year  or  more,  and  many  experience  high  end  truncation.  The 
liSl  unit  may  or  may  not  have  had  a  similar  change.  It  has  not  been  calibrated  in  2  years, 
but  it  may  not  change  as  much  per  year  due  to  its  much  shorter  duty  cycle  of  only  a  few 
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hours  a  day.  The  fact  remains  that  tins  is  a  very  si>  lificant  source  ot  error  that  deserves 
some  attention. 

Over  the  short  run.  an  immediate  answer  to  the  problem  of  drift  in  the  system  response 
is  to  recalibrate  the  sensors  more  frequently.  In  particular,  we  need  to  cheek  the  response 
of  the  two  units  currently  in  use  in  HS1  units.  Over  the  long  run,  the  use  of  some  sort  of 
in-field  calibration  device  may  lx.-  warranted.  Placing  a  light  trap  in  the  field  of  view  at  the 
home  position  should  allow  us  to  monitor  the  increase  in  the  full  dark  level.  The  occasional 
use  of  an  artificial  source  which  would  saturate  the  image  (radiometrically  i  would  allow 
monitoring  of  the  high  end  truncation. 

It  feasible,  the  use  of  a  field  calibration  device  which  could  provide  well  defined 
relative  flux  levels  within  an  image  might  allow  in-situ  determination  of  the  effective 
response  curve,  for  in-field  updating  of  the  linearity  curve.  In  short,  the  type  ot  error 
indicated  by  Test  5  is  one  that  should  be  reasonably  avoidable,  through  proper  calibration 
of  the  camera,  but  it  is  an  error  that  is  apparently  important  to  avoid. 

6.0  SENSITIVITY  TO  TARGET  RANGE  AND  CONTRAST 
THRESHOLD 

In  the  previous  sections,  plots  have  been  shown  which  illustrate  the  system  sensitivity 
to  errors  in  the  input  C0  value,  errors  in  the  measured  target  and  horizon  radiances,  and 
errors  due  to  system  response  non-linearity.  There  are  two  remaining  input  values;  the 
target  range,  and  the  e  threshold. 

6.1  Sensitivity  to  Target  Range 


In  considering  errors  in  target  range,  it  is  probably  reasonable  to  consider  the  fractional 
error.  F  or  a  target  which  is  near,  it  is  reasonably  easy  to  pinpoint  its  location  within  a  small 
radius.  F  or  a  Luther  target,  it  is  increasingly  difficult  to  pinpoint  its  location;  the  expected 
uncertainty  might  be  a  given  fraction  of  the  target  distance. 

The  sensitiv  ity  of  visibility  to  errors  in  target  range  of  a  given  percent  is  quite  easy  to 
compute.  F  rom  Eq.  2.2,  it  ma\  be  shown  that  an  error  of  \r/t  in  range  yields  an  erroi  ot 
the  same  percent  in  visibility.  That  is,  if  one  inputs  a  range  value  which  is  5'f  high,  the 
resulting  visibility  will  tv  5r.l  high.  T  his  is  a  simple  enough  relationship  that  no  plots  were 
made,  it  is  safe  to  conclude  that  if  the  HSI  is  to  be  accurate  within  a  given  percent,  the 
target  ranges  must  be  accurate  to  that  percent. 

6.2  Sensitivity  to  Contrast  Threshold 

The  situation  with  visual  threshold  £  is  somewhat  different.  It  is  my  opinion  that  this 
number  should  not  normally  be  varied.  Visibility  is  defined  in  terms  of  a  threshold  contrast 
of  .05.  The  human  has  a  threshold  contrast  of  approximately  .05,  if  the  target  size  and 
light  adaptation  level  are  maintained,  along  with  other  parameters  such  its  glimpse  time. 

fhe  human  threshold  contrast  is  significantly  changed  if  these  conditions  are  changed, 
for  example,  if  the  human  looks  at  a  very  small  target  (or  very  large),  the  threshold 
•ontrast  will  change,  and  the  human  will  make  an  erroneous  determination  of  visibility.  Ff 
ue  choose  to  change  the  input  r  value  in  the  HSI.  we  can  simulate  the  human  error,  and 
estimate  the  expected  error  that  the  human  might  make.  In  general  however,  the  HSI 
should  try  to  return  the  correct  visibility,  not  what  the  human  might  call  w  ith  an  inadequate 
ur-act.  We  do  this  by  maintaining  the  input  c  value  associated  witli  the  definition  of 


visibility.  Therefore  for  this  sensitivity  study,  it  was  not  deemed  appropriate  to  determine 
sensitivity  to  changes  in  r. 

7.0  SUMMARY 

Two  summary  plots,  containing  curves  extracted  from  the  earlier  sections,  have  been 
created:  one  for  Q,  -  .8,  l.<j  =  2(X),  and  one  for  C(,  -  .5,  Lt)  =  200.  In  these  plots,  the  four 
curves  show:  the  impact  ot  a  Cu  change  of  .1;  the  impact  of  a  measured  target  radiance 
change  of  4  (on  the  0  to  255  scale);  the  impact  of  a  measured  horizon  radiance  change  of  4, 
and  the  impact  of  system  non-linearity  for  the  system  at  Otis. 

All  of  these  uncertainties  can  cause  a  certain  amount  of  error.  The  sensitivity  to  C„ 
uncertainty  is  very  small  when  the  target  ranee  is  close  to  the  visibility  (near  Cr  =  .05),  and 
fairly  large  when  the  target  is  closer.  Unfortunately  however,  the  measurement 
uncertainties  cause  the  most  error  when  the  target  range  is  close  to  the  visibility.  That  is. 
when  the  Oc  impacts  are  least,  the  measurement  error  impacts  are  largest. 

There  are  some  techniques  for  improving  our  C(,  estimates,  hut  in  the  final  analysis  the 
C0  changes  may  be  most  difficult  to  handle.  The  measurement  uncertainties  may  in  many 
eases  be  mitigated  by  a  combination  of  improved  measurements  techniques  and  improved 
data  reduction  techniques.  As  the  magnitude  and/or  impact  of  measurement  uncertainties 
are  improved,  it  should  be  possible  to  chose  targets  closer  to  the  visual  threshold,  which 
should  help  mitigate  the  impact  of  the  Cc  uncertainties. 

Another  way  to  look  at  the  system  is  to  consider  that  the  ability  to  determine  visibility 
from  targets  ranging  near  the  visibility  depends  on  the  ability  to  accurately  determine  the 
difference  between  signals  which  are  quite  close.  This  requires  precision,  stability,  and 
accuracy  in  the  measurements  acquired  by  the  system.  At  the  other  extreme,  the  ability  to 
determine  visibility  from  targets  which  are  at  close  range  (and  which  therefore  have 
apparent  contrast  somewhat  close  to  the  inherent  contrast)  depends  on  our  ability  to 
accurately  characterize  the  C0  values  and  their  fluctuations. 

In  the  short  run,  there  are  obvious  ways  in  which  improvements  can  be  made  in  terms 
of  measurements.  These  include  keeping  the  horizon  radiance  near  2(X>,  and  measuring 
and  applying  the  non-linearity  correction.  Other  potential  improvements  such  as  correcting 
for  chip  non-uniformity,  to  improve  measurement  accuracy,  may  or  may  not  be  warranted. 
There  are  a  variety  of  tests  to  help  us  determine  questions  such  as  this  one. 

A  significant  improvement  in  the  current  accuracy  should  be  readily  realized  as  these 
changes  are  enacted.  In  the  long  run,  as  solid  state  sensors  improve  in  stability  and  noise 
handling,  we  should  expect  significant  improvements  in  the  measurement  capabilities. 
These  in  turn  should  allow  us  to  m  ike  better  use  of  the  measurement  regimes  in  which  the 
sens,  .vity  to  C(>  changes  becomes  small. 

8.0  RECOMMENDATIONS 

As  an  outcome  of  this  study,  there  are  a  number  of  changes  and/or  tests  which  should 
be  considered.  These  fall  roughly  into  two  categories.  The  first  category  is  changes 
having  to  do  with  measurement  accuracy,  including  both  improvements  to  the  measurement 
accuracy,  and  changes  to  mitigate  the  impact  of  measurement  inaccuracy.  The  second 
category  is  changes  having  to  do  with  the  handling  of  non-ideal  measurement  conditions, 
such  as  non -ideal  targets  or  non-ideal  horizon  skies.  These  two  types  of  improvement 
categories  will  be  discussed  below. 
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8.1  Improvements  Relating  to  Measurement  Accuracy 

The  first  and  most  obvious  change  I  would  recommend  is  to  ensure  that  the  horizon 
radiance  is  near  200  counts.  Whereas  this  does  not  in  itself  increase  the  measurement 
accuracy,  it  significantly  mitigates  the  effects  of  measurement  inaccuracy.  With  the  MIM. 
unit,  the  horizon  signal  is  currently  near  1(H),  we  need  to  verify  that  the  camera  response 
has  not  become  truncated  due  to  internal  problems,  and  then  adjust  the  auto-ins  to  yield  a 
horizon  brightness  near  200.  With  the  Otis  unit,  we  similarly  need  to  determine  the  current 
signals  which  occur  for  the  horizon,  and  optimize  them  as  necessary. 

We  need  to  acquire  a  new  linearity  calibration  for  the  MPL  unit,  to  determine  how 
much  change,  if  any,  has  occurred  since  the  original  calibration.  It  will  be  somewhat  more 
difficult  to  acquire  a  linearity  calibration  for  the  Otis  unit,  but  this  is  certainly  something  to 
do  when  possible.  1  wouid  propose  that  we  incorporate  application  of  the  linearity 
correction  into  a  test  version  of  the  software.  We  should  devise  a  technique  for  testing  the 
sensor  response  in  the  field.  Installation  of  a  light  trap,  to  enable  testing  of  the  dark  end  of 
the  responsivity  curve,  could  help  us  begin  testing  the  efficacy  of  this  sort  of  in-situ 
procedure. 

Next,  there  are  several  tests  that  involve  investigation  of  the  magnitude  of  existing 
measurement  errors.  As  discussed  earlier,  both  the  horizon  and  target  radiances  are 
impacted  by  noise,  changes  in  full  dark,  and  chip  non-uniformity.  Any  change  in  full  dark 
may  be  treated  as  part  of  the  sensor  responsivity  change  documented  by  the  linearity 
calibration,  and  need  not  be  treated  separately  for  now. 

The  magnitude  of  system  noise  averaged  over  the  horizon  and  target  ROI's  may  be 
evaluated  by  grabbing  several  images  of  the  same  scene  in  close  temporal  succession,  and 
comparing  the  resulting  signals  averaged  over  the  ROI's.  The  errors  due  to  chip  non¬ 
uniformity  may  be  evaluated  using  the  linearity  calibration  data.  If  one  wants  to  know  the 
magnitude  of  non-uniformity  for  a  given  target  location,  one  extracts  the  signal  for  that 
target  ROI  and  for  the  horizon  ROI,  but  using  a  calibration  image  of  a  uniform  source.  We 
can  then  decide  if  either  system  noise  or  chip  non-uniformity  cause  errors  large  enough  to 
require  compensation. 

Since  the  impact  of  measurement  error  is  worst  as  V/r  approaches  the  lower  limit  of 
1.15,  and  the  impact  of  non-ideal  C()  is  wor.>t  as  V/r  approaches  4.0,  there  is  benefit  in 
avoiding  these  limits.  Since  the  optimum  range  is  a  function  of  the  visibility,  it  is  important 
to  have  enough  targets  so  that  there  are  always  several  within  the  optimum  range,  for  all 
possible  visibility  values. 

Within  the  limits  imposed  by  the  availability  of  real  world  targets,  an  effort  should  be 
made  to  select  many  targets  over  a  range  of  target  distances.  (For  those  familiar  with 
transmissometers,  it  may  be  helpful  to  note  that  whereas  a  transmissometer  is  reasonably 
accurate  over  a  range  of  visibility  values  determined  by  its  base  length,  the  HSI  is 
reasonably  accurate  over  a  range  of  visibility  values  determined  by  the  target  ranges.  By 
using  very  near  targets  under  loss  visibility  conditions,  and  far  targets  under  high  visibility 
conditions,  we  are  creating  an  impact  similar  to  adjusting  the  transmissometer  base  length.) 

Note  also  that  it  is  very  important  that  the  range  to  these  targets  be  determined 
accurately,  since  the  error  in  visibility  due  to  an  error  in  range  is  directly  proportional  to  the 
range  error.  This  may  involve  driving  out  to  the  sites,  and  visually  identifying  the  targets 
being  used. 


8.2  Improvements  Relating  to  Non-ideal  Conditions 

There  are  several  things  which  can  he  done  to  improve  the  system  with  regard  to  non- 
ideal  conditions,  first,  consider  the  impact  of  horizon  sky  problems.  If  the  measured 
horizon  radiance  is  not  equal  to  the  equilibrium  radiance,  there  is  a  corresponding  error  in 
the  visibility.  Under  clear  sky  conditions,  the  near-horizon  radiance  is  expected  to  decrease 
away  from  the  equilibrium  radiance  value  as  the  elevation  angle  is  increased.  This  occurs 
due  to  the  decreasing  turbidity  of  the  path  of  sight. 

It  would  be  instructive  to  extract  the  change  in  horizon  radiance  over  the  range  of 
elevation  tingle  in  the  MSI  field -of-view.  This  can  be  done  with  existing  MSI  imagers 
This  would  allow  us  to  determine  the  range  of  elevation  angles  which  provide  a  sufficiently 
accurate  determination  of  the  equilibrium  radiance  (in  the  absence  of  clouds). 

Similarly,  w-e  should  investigate  the  incidence  of  clouds  on  the  horizon  which  are 
bright  enough  to  cause  error.  We  can  probably  improve  our  handling  of  this  possibility  by 
using  two  horizon  ROl's,  and  checking  the  signal  standard  deviation  in  each,  as  well  a>  the 
difference  in  the  average  signals.  If  one  ROl  has  a  high  STD  and/or  elevated  signal,  use  ot 
the  other  ROl  might  avoid  the  cloud.  If  both  ROl's  have  high  STD's,  there  is  probabK 
little  that  can  lie  done  currently  other  than  alert  the  user,  or  potentially  not  use  the  visibility 
for  that  scene.  A  test  program  to  investigate  these  possibilities  should  be  implemented. 

Over  the  longer  run,  the  case  of  cloud  clutter  at  the  horizon  might  be  addressed  by  the 
next  generation  larger  field-of-view  WSI.  If  we  make  determinations  using  the  WSI  of 
where  the  clouds  are.  it  should  be  feasible  to  utilize  horizon  ROl's  which  are  in  the  clear 
areas  indicated  by  the  WSI.  Similarly,  introduction  of  a  red/blue  filter  changer  to  the  HS1 
could  allow  determination  of  the  clear  horizon  regions  for  use  in  visibility  determination. 

Finally  comes  the  really  difficult  problem,  changes  is  (  Once  we  have  improved  the 
accuracy  of  the  system  in  the  ways  discussed  above,  we  will  probably  want  to  tackle 
determination  of  C„  This  is  done  by  using  the  median  visibility  determined  from  the 
available  targets,  or  an  independently  determined  visibility,  then  determining  what 
values  for  each  target  will  yield  that  visibility. 

It  would  be  very  helpful  to  run  curves  similar  to  the  ones  in  this  technical  note  which 
determine  the  sensitivity  of  the  C0  determination  to  known  errors,  so  that  we  can  adjust  our 
technique  appropriately.  (For  example,  we  know  intuitively  that  the  targets  must  be  at 
close  range,  relative  to  the  visibility,  in  order  for  visibility  to  be  sensitive  to  C0.  which 
means  targets  must  be  close  to  back  out  the  C0  value.  Hut  does  measurement  error  then 
cause  undue  problems?) 

If  we  are  successful  with  Cj,  extraction,  a  study  of  the  time  variation  in  C„  would  be 
helpful.  The  equilibrium  radiance  is  expected  to  change  as  a  function  of  the  scattering  angle 
with  respect  to  the  sun.  This  gives  us  a  theoretical  change  in  Cu  due  to  the  change  in  the 
horizon  brightness.  If  this  is  dominant  over  changes  due  to  target  brightness,  the  diurnal 
changes  in  C„  might  be  reasonably  predictable. 

9.0  CONCLUSION 

This  note  has  presented  plots  illustrating  the  sensitivity  of  the  visibility  derived  from 
the  HSI  measurements  to  a  variety  of  sources  of  uncertainty.  In  general,  the  errors  depend 
on  the  magnitude  of  the  apparent  contrast,  which  in  turn  depends  on  the  relative  values  of 
visibility  and  target  range.  The  sensitivity  to  measurement  error  is  maximized  when  the 


target  range  is  close  to  the  visibility;  the  sensitivity  to  inherent  contrast,  on  the  other  hand, 
is  greatest  when  the  target  range  is  much  less  than  the  visibility. 

This  study  has  defined  some  obvious  ways  to  improve  the  system,  as  well  as  some 
areas  requiring  investigation  of  the  data.  Over  the  long  term,  retrofitting  the  HSI  with  the 
new  generation  of  cooled  solid  state  sensors  provides  potential  for  further  improvement. 
With  less  noise,  higher  radiance  resolution,  and  better  stability,  these  cameras  should  allow 
more  precise  measurements  and  a  corresponding  improvement  in  the  visibility 
determinations  from  the  HSI. 
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